Python Job: Google Cloud Platform Developer

Job added on

Company

ABN TECH CORP

Location

Toronto, Ontario - Canada

Job type

Full-Time

Python Job Details

Title: Sr. Google Cloud Platform Developer

Location: Toronto, Canada

Duration: Full time

Visa: Citizen, PR, Open to work permit

Note: Fulltime Sr. Google Cloud Platform Developer.

Job Description:

Key accountabilities/ Experience:

  • Designing, building, operationalizing the Wealth Data Hub (WDH) using Google Cloud Platform (Google Cloud Platform) data services such as DataProc, Dataflow, CloudSQL, BigQuery, CloudSpanner in combination with third parties such as Spark, Apache Beam/ composer, DBT, Cloud PubSub, Confluent Kafka, Cloud storage Cloud Functions & Github
  • Designing and implementing data ingestion patterns that will support batch, streaming and API interface on both the Ingress and Egress.
  • Guide a team of data engineers and work hands on in developing framework and custom code using best practices that will meet the demanding performance requirements.
  • Take a lead in designing and building production data pipelines from data ingestion to consumption using Google Cloud Platform services, Java, Python, Scala, BigQuery, DBT, SQL etc.
  • Experience using Cloud Dataflow using Java/Python for deploying streaming jobs in Google Cloud Platform as well as batch jobs using text/ISON files and writing them to BigQuery Building and managing data pipelines with a deep understanding of workflow orchestration, task scheduling and dependency management.
  • Ability to do proof of technology using Google Cloud Platform technologies and work with data architects, solution architects to achieve the desired results and performance.
  • Provide end-to-end technical guidance and expertise on how to effectively use Google Cloud to build solutions; creatively applying cloud infrastructure and platform services to help solve business problems; and communicating these approaches to different business users.
  • Provide guidance on Implementing application logging, notification, jobs monitoring and performance monitoring.

Functional Competencies and Skills:

  • 10+ years of experience in data engineering, performance optimization for large OLTP applications with a minimum of 4+ years of working experience as Google Cloud Platform (Google Cloud Platform) developer
  • Experience with the primary managed data services within Google Cloud Platform, including DataProc, Dataflow, BigQuery/DBT, Cloud Spanner, Cloud SQL, Cloud Pub/Sub etc.
  • Experience with Google Cloud Platform Databases (SQL, Spanner, PostgreSQL).
  • Experience working with relational/NoSQL databases.
  • Experience with data streaming and technologies such as Kafka, Spark-streaming etc.
  • Experience with Infrastructure as Code (laC) practices and frameworks like Terraform.
  • Knowledge of Java microservices and Spring Boot.
  • Strong architecture knowledge with experience in providing technical solutions for cloud infrastructure.
  • Working knowledge of developing and scaling JAVA REST services, using frameworks such as Spring.
  • Good communication and problem-solving skills. Ability to effectively convey ideas to business and technical teams.